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1 Overview 

The class's goals, requirements, and policies were introduced, and topics in the class were described. Every- 
thing in the overview should be in the course syllabus, so please consult that for a complete description. 

2 Linear Algebra Review 

This course requires linear algebra, so here is a quick review of the facts we will use frequently. 
Definition 1 Let M by an n x n matrix. Suppose that 

Mx = Xx 

for x G W 1 , i/0 ; and X G R. Then we call x an eigenvector and X an eigenvalue of M. 
Proposition 2 If M is a symmetric n x n matrix, then 

• If v and w are eigenvectors of M with different eigenvalues, then v and w are orthogonal (v • w = 0). 

• If v and w are eigenvectors of M with the same eigenvalue, then so is q = av + bw , so eigenvectors 
with the same eigenvalue need not be orthogonal. 

• M has a full orthonormal basis of eigenvectors vi,...,v n . All eigenvalues and eigenvectors are real. 

• M is diagonalizable: 

M = VAV T 

where V is orthogonal (VV T = I n ), with columns equal to v\,...,v n , and A is diagonal, with the 
corresponding eigenvalues of M as its diagonal entries. So M = Y^i=i ^i v i v I - 

In Proposition 2, it was important that M was symmetric. No results stated there are necessarily true 
in the case that M is not symmetric. 

Definition 3 We call the span of the eigenvectors with the same eigenvalue an eigenspace. 

3 Matrices for Graphs 

During this course we will study the following matrices that are naturally associated with a graph: 

• The Adjacency Matrix 

• The Random Walk Matrix 

• The Laplacian Matrix 

• The Normalized Laplacian Matrix 
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Let G = (V, E) be a graph, where \V\ = n and \E\ = m. We will for this lecture assume that G is 
unweighted, undirected, and has no multiple edges or self loops. 



Definition 4 For a graph G, the adjacency matrix A = A G is the n x n matrix given by 

A = r i if(i,j)€E 

| otherwise 
For an unweighted graph G, Aq is clearly symmetric. 
Definition 5 Given an unweighted graph G, the Laplacian matrix L = L G is the n x n matrix given by 

-1 if(hj)eE 



di ifi = j 
otherwise 



where di is the degree of the i th vertex. 



For unweighted G, the Laplacian matrix is clearly symmetric. An equivalent definition for the Laplacian 
matrix is 

L G = D G -A G , 

where D G is the diagonal matrix with i th diagonal entry equal to the degree of Vi, and A G is the adjacency 
matrix. 



4 Example Laplacians 

Consider the graph H with adjacency matrix 



This graph has Laplacian 
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Now consider the graph G with adjacency matrix 

A G 

This graph has Laplacian 

L G = 



L G is a matrix, and thus a linear transformation. We would like to understand how L G acts on a vector 
v. To do this, it will help to think of a vector v G M 3 as a map X : V — > R. We can thus write v as 



1 


-1 


-1 


2 -1 





-1 1 



1-2 




The action of Lq on v is then 





X(l)-X(2) 
2X(2) -X(l) -X(3) 
X(3)-X(2) 



( X(l)-X(2) \ 
2 (x(2) - [ X(1) + X(3) ]) 
X(3)-X(2) 



For a general Laplacian, we will have 

[Lcv]i = [di * (X(i) — average of X on neighbors of i)] 

Remark For any G, 1 = (1, . . . , 1) is an eigenvector of Lq with eigenvalue 0, since for this vector X(i) 
always equals the average of its neighbors' values. 

Proposition 6 We will see later the following results about the eigenvalues Xi and corresponding eigenvec- 
tors Vi of Lq ' 

• Order the eigenvalues so Ai < . . . < \ n , with corresponding eigenvectors vi,...,v n . Then v\ = 1 and 
Ai = 0. So for all i Xi > 0. 

• One can get much information about the graph G from just the first few nontrivial eigenvectors. 

5 Matlab Demonstration 

As remarked before, vectors v G M n may be construed as maps X v : V — > R. Thus each eigenvector assigns a 
real number to each vertex in G. A point in the plane is a pair of real numbers, so we can embed a connected 
graph into the plane using (X V2 ,X V3 ) : V — > M 2 . The following examples generated in Matlab show that 
this embedding provides representations of some planar graphs. 





0.05 0.1 0.15 0.2 



Image courtesy of Dan Spielman. Used with Permission. 
Figure 1: Plots of the first two nontrivial eigenvectors for a ring graph and a grid graph 
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Image courtesy of Dan Spielman. Used with Permission. 
Figure 3: Handmade graph embedding (left) and plot of first two nontrivial eigenvectors (right) for a graph 
used to model an airfoil 
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